CLAIM AMENDMENTS 



Claim Amendment Summary 
Claims pending 

• Before this Amendment: Claims 1-4, 6-9, 11-14, 16-28 and 30-36. 

• After this Amendment: Claims 1-4, 6-9, 11-14, 16-28 and 30-36 
Non-Elected, Canceled, or Withdrawn claims: None 

Amended claims: 14, 17, 18, and 23 
New claims: None 
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Claims: 

1. (Previously Presented) A method of managing annotations in a pen- 
based computing system, the method comprising: 

monitoring an electronic document for user annotations; 

recognizing entry of an annotation into the electronic document; 

collecting context data proximal to the annotation, wherein the context data 
comprises: 

time; 

location; and 

surrounding text; and 
determining whether the annotation comprises a gesture, wherein the gesture is an 
ink object commanding user defined functionality of a computer; 

determining whether the annotation is associated with a date; 
responsive to determining the annotation is associated with a date, determining if a 
date launch feature is enabled, such that: 

in an event no date launch feature is enabled, continuing monitoring the 
electronic document for user annotations; 

in an event the date launch feature is enabled, launching an associated 
application; 

locating information related to the annotation using the annotation and the context 

data; 
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wherein the collecting context data comprises: 
deriving at least two search terms; 

comparing the search terms to a history of search terms; and 

weighting each of the search terms according to whether a particular search 
term is included in the history of search terms, a higher weight being assigned to a 
search term that is included in the history of search terms; and 
wherein the locating information related to the annotation comprises: 

determining keywords that are likely to be of interest to a user based on the 
annotation and words contained in documents previously accessed by the user; and 

using the keywords to locate information such that: 

in an event a user-specified domain is selected, the keywords are 

used to locate information in one of a plurality of user-specified domains 

comprising: 

a local computer; 

a local network drive; and 

the Internet. 

2. (Original) The method as recited in claim 1, wherein the collecting 
context data further comprises extracting one or more words from text proximal to the 
annotation. 
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3. (Original) The method as recited in claim 1, wherein the collecting 
context data further comprises locating objects near to an annotation object in a document 
object model (DOM) associated with the annotation. 



4. (Original) The method as recited in claim 1, wherein the collecting 
context data further comprises: 

defining a first distance from the annotation; 
defining a second distance from the annotation; 

locating one or more keywords that are within the first distance from the 
annotation; 

locating one or more keywords that are within the second distance from the 
annotation but not within the first distance from the annotation; 

weighting the one or more keywords according to their distance from the 
annotation, with keywords within the first distance having a greater weight than 
keywords within the second distance but not within the first distance; and 

wherein the locating information related to the annotation utilizes the keywords 
according to the weights assigned thereto. 



5. (Canceled) 



6. (Previously Presented) The method as recited in claim 1 , wherein the 



history of search terms comprises a history of search terms used by a particular user. 
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7. (Previously Presented) The method as recited in claim 1, wherein the 
history of search terms comprises a history of search terms used by all users of a 
particular group of users. 



8. (Original) The method as recited in claim 1, wherein the locating 
information related to the annotation further comprises searching the electronic document 
for terms that match or are similar to the annotation. 

9. (Original) The method as recited in claim 1, wherein the locating 
information related to the annotation further comprises searching remote sites for 
documents containing terms that match or are similar to the annotation. 

10. (Canceled) 

11. (Previously Presented) The method as recited in claim 1, wherein the 
documents that were previously accessed by the user are limited to documents accessed 
within a specified time period. 

12. (Previously Presented) The method as recited in claim 1, wherein the 
determining keywords that are likely to be of interest to a user based on the annotation 
and words contained in documents previously accessed by the user comprises: 
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determining keywords that are likely to be of interest to the user based on the 
annotation and words occurring with the annotations in the documents that were 
previously accessed by the user. 

13. (Previously Presented) The method as recited in claim 1, wherein 
annotations are recognized from a plurality of types of annotations, the plurality of types 
of annotations comprising: 

circle; 

underline; 

block; 

arrow; 

callout; 

free note; and 

post-it note. 

14. (Currently Amended) An annotation management system, comprising: 
a processor; 

a system memory coupled to the processor, the system memory comprising: 

a feature database configured to store a gesture comprising an ink object 

commanding user defined functionality of the system; 

an annotation monitoring module configured to monitor an electronic 

document for entry of an annotation; 
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the annotation monitoring module further configured to recognize entry of 



an annotation into the electronic document: 



an extraction module configured to perform acts comprising: 

collecting eelleet context data that appears proximal to the nc ox cm 
annotation e nt e r e d into th e e l e ctronic docum e nt and to e xtract on e or mor e 
keywords from the context data, the extraction module further configured 
to d e t e rmin e k e ywords that ar e likely to b e of int e r e st to a us e r bas e d on 
words contained in documents previously accessed by the user , wherein the 
context data comprises: 
time : 

location: and 
surrounding text: and 
determining whether the annotation comprises a gesture, wherein the 
gesture is an ink object commanding user defined functionality of a 
computer; 

determining whether the annotation is associated with a date; 
responsive to determining the annotation is associated with a date, 
determining if a date launch feature is enabled, such that: 

in an event no date launch feature is enabled, continuing 
monitoring the electronic document for user annotations; 

in an event the date launch feature is enabled, launching an 
associated application; 
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a query modification module configured to locate information related to the 
annotation using the annotation and the context data; 

the extraction module further configured such that collecting context data 
comprises: 

deriving at least two search terms; 

comparing the search terms to a history of search terms; and 
weighting each of the search terms according to whether a particular 
search term is included in the history of search terms, a higher 
weight being assigned to a search term that is included in the history 
of search terms; and 
an information processing module configured to locate information related 
to the annotation, utiliz e th e annotation and th e k e ywords to locat e r e lat e d cont e nt 
V-an d wherein the locating information related to the annotation comprises: 

determining keywords that are likely to be of interest to a user based 
on the annotation and words contained in documents previously accessed 
by the user; and 

using the keywords to locate information such that: 

in an event a user-specified domain is selected, the keywords 
are used to locate information in one of a plurality of user-specified 
domains comprising: 

a local computer; 

a local network drive; and 
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the Internet 

a history modul e that includ e s one or mor e historical k e ywords that w e r e 
previously used in the system in at least one query for one or more searches; 

wh e r e in th e e xtraction modul e is furth e r configur e d to w e ight k e ywords 
according to wh e th e r or not th e keywords ar e includ e d in th e history modul e ; and 

wherein the information processing module is further configured to locate 
th e r e lat e d cont e nt bas e d on th e annotation, th e on e or mor e k e ywords from th e 
context data, and the weighted keywords as weighted according to whether or not 
th e k e ywords ar e includ e d in th e history modul e. 

15. (Canceled) 

16. (Previously Presented) The system as recited in claim 14, wherein: 

the context data comprises a plurality of keywords derived from text proximal to 
the annotation; 

the extraction module is further configured to weight each keyword according to a 
relative distance that the keyword is from the annotation; and 

the information processing module is further configured to locate the related 
content based on the weighted keywords as weighted according to the relative distance 
that each keyword is from the annotation. 



Serial No.: 10/659,568 

Atty Docket No.: MS1-1524US 

Atty/Agent: Beatrice L. Koempel-Thomas 



17. (Currently Amended) The system as recited in claim 16, wherein [[the]] a 
search is performed using the annotation as a search term and the results of the search are 
re-ranked according to the weighted keywords as weighted according to the relative 
distance that each keyword is from the annotation. 



18. (Currently Amended) The system as recited in claim 16, wherein [[the]] a 
search is performed using a query derived from the annotation and the weighted 
keywords as weighted according to the relative distance that each keyword is from the 
annotation. 



19. (Previously Presented) The system as recited in claim 14, wherein the 
related content located by the information processing module comprises keywords 
contained in the electronic document. 



20. (Previously Presented) The system as recited in claim 14, wherein the 
related content located by the information processing module comprises documents on a 
network that contain one or more of the keywords. 



21. (Previously Presented) The system as recited in claim 14, wherein the 
information processing module is further configured to determine suggested keywords 
that are likely to be of interest to the user based on the annotation and words appearing in 
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other documents previously accessed by the user in which the same annotation was 
entered. 



22. (Original) The system as recited in claim 21, further comprising a user 
interface configured to present the suggested keywords to the user and provide for 
selection of none or one or more of the suggested keywords by the user. 



23. (Currently Amended) One or more computer-readable media 
containing having computer-executable instructions embodied on at least one tangible 
component of the computer-readable media t hat, the computer-executable instructions 
when executed on a computer, cause the computer to perform steps comprising: 

monitoring an electronic document for user annotations: 

recognizing an annotation entered into [[an]] the electronic document by a user ; 

collecting context data proximal to the annotation, wherein the context data 
comprises: 

time; 

location; and 

surrounding text; and 
determining whether the annotation comprises a gesture, wherein the gesture is an 
ink object commanding user defined functionality of a computer; 

determining whether the annotation is associated with a date; 
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responsive to determining the annotation is associated with a date, determining if a 
date launch feature is enabled, such that: 

in an event no date launch feature is enabled, monitoring the electronic 
document for additional user annotations; 

in an event the date launch feature is enabled, launching an associated 
application; 

locating information related to the annotation using the annotation and the context 

data; 

wherein the collecting context data father-comprises: 
deriving at least two search terms; 

comparing the search terms to a history of search terms; and 

weighting each of the search terms according to whether a particular search 
term is included in the history of search terms, a higher weight being assigned to a 
search term that is included in the history of search terms; and 
wherein the locating information related to the annotation further comprises: 

determining keywords that are likely to be of interest to a user based on the 
annotation and words contained in documents previously accessed by the user; and 

using the keywords to locate information such that: 

in an event a user-specified domain is selected, the keywords are 

used to locate information in one of a plurality of user-specified domains 

comprising: 

a local computer; 
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a local network drive; and 
the Internet 

collecting context data related to the location of the annotation to produce 
k e ywords; 

d e t e rmining k e ywords that ar e likely to b e of int e r e st to a us e r bas e d on words 
contained in documents previously accessed by the user; 

locating additional cont e nt that may b e of int e r e st to th e us e r by e x e cuting a s e arch 
with search terms selected from (i) one or more words indicated by the annotation and (ii) 
on e or mor e k e ywords d e riv e d from th e context data and from th e docum e nts that w e r e 
previously accessed by the user and by weighting at least a portion of the search terms 
bas e d on a k e yword history list that includ e s pr e viously - us e d k e ywords that w e r e us e d in 
at l e ast on e qu e ry in on e or more previous s e arch e s; and 

providing results of the search via an output peripheral device . 



24. (Previously Presented) The one or more computer-readable media as 
recited in claim 23, wherein annotations are recognized from a plurality of types of 
annotations, the plurality of types of annotations comprising: 

a circle; 

a box; 

an arrow; 

an underline; 

a double underline; 
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a bracket; 
a highlight; 

a handwritten character; 
a free note; 
a post-it note. 

25. (Previously Presented) The one or more computer-readable media as 
recited in claim 23, wherein the collecting context data related to the location of the 
annotation comprises collecting objects occurring within a certain distance from an 
annotation object in a document object model associated with the annotation object. 

26. (Previously Presented) The one or more computer-readable media as 
recited in claim 23, wherein the locating additional content comprises locating one or 
more local keywords in the electronic document. 

27. (Previously Presented) The one or more computer-readable media as 
recited in claim 23, wherein the locating additional content comprises locating one or 
more documents on a network that include one or more words indicated by the annotation 
or one or more keywords derived from the context data or from the documents that were 
previously accessed by the user. 
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28. (Previously Presented) The one or more computer-readable media as 
recited in claim 23, wherein the locating additional content comprises deriving the one or 
more keywords from the context data by identifying words that frequently appear with 
the annotation in other documents accessed by the user. 



29. (Canceled) 



30. (Previously Presented) The one or more computer-readable media as 
recited in claim 23, wherein the steps further comprise: 

ranking search results according to the weighted search terms. 



31. (Previously Presented) The one or more computer-readable media as 
recited in claim 30, wherein the previously-used keywords were previously used by a 
current user, and wherein the weighting of at least a portion of the search terms comprises 
assigning a higher weight to search terms that are included in the keyword history list for 
the current user. 



32. (Previously Presented) The one or more computer-readable media as 
recited in claim 30, wherein the previously-used keywords were previously used by all 
users in a group of users, and wherein the weighting of at least a portion of the search 
terms comprises assigning a higher weight to search terms that are included in the 
keyword history list for the group of users. 
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33. (Previously Presented) The method as recited in claim 1 , further 
comprising: 

detecting user input comprising a gesture associated with a search task; 
wherein the locating information related to the annotation using the annotation and 
the context data is performed responsive to the detecting. 

34. (Previously Presented) The method as recited in claim 33, further 
comprising: 

assigning, by the user, the search task to the gesture so as to associate the gesture 
with the search task. 



35. (Previously Presented) The system as recited in claim 14, wherein the 
information processing module is further configured to perform a search to locate the 
related content responsive to when the annotation monitoring module detects user input 
of a gesture that is associated with a search task. 



36. (Previously Presented) The one or more computer-readable media as 
recited in claim 23, wherein the steps further comprise: 

detecting user input of a gesture that is associated with a search task; 

wherein the locating additional content that may be of interest to the user by 
executing a search is performed responsive to the detecting. 
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